Mobile terminal and controlling method thereof

ABSTRACT

A mobile terminal including a user input unit configured to receive user-inputs; a wireless communication unit configured to wirelessly communicate with at least one other terminal; at least one camera configured to capture images; a touchscreen configured to display a camera preview image captured by the camera; a position-location processor configured to obtain information on a current position of the mobile terminal; and a controller configured to search for textual object information corresponding to an object within the camera preview image based on the current position of the mobile terminal, to control the camera to photograph the camera preview image and to store the photographed camera preview image as a picture file, to output query information to query whether the searched textual object information is to be stored together with the picture file, and to store the picture file with or without the searched textual object information based on an answer to the output query information.

Pursuant to 35 U.S.C. §119(a), this application claims the benefit of anearlier filing date and right of priority to Korean Application Nos.10-2009-0079696 and 10-2009-0079697, filed on Aug. 27, 2009, thecontents of which are hereby incorporated by reference in theirentirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a mobile terminal and correspondingmethod for displaying object textual information on the touchscreenidentifying objects included within a preview image based on an obtainedcurrent position of the mobile terminal.

2. Discussion of the Related Art

A mobile terminal is a device which may be configured to perform variousfunctions. Examples of such functions include data and voicecommunications, capturing images and video via a camera, recordingaudio, playing music files, and displaying images and video on adisplay. Some terminals include additional functionality which supportsgame playing, while other terminals are also configured as multimediaplayers. More recently, mobile terminals have been configured to receivebroadcast and multicast signals which permit viewing of contents, suchas videos and television programs.

Generally, terminals can be classified into mobile terminals andstationary terminals according to a presence or non-presence ofmobility. In addition, the mobile terminals can be further classifiedinto handheld terminals and vehicle mount terminals. There are ongoingefforts to support and increase the functionality of mobile terminals.Such efforts include software and hardware improvements, as well aschanges and improvements in the structural components which form themobile terminal.

The mobile terminal also includes a camera allowing the user to takepictures or movies. Also, the mobile terminal includes a graphical userinterface to assist the user in taking pictures or movies. However, theinformation provided is limited in nature.

SUMMARY OF THE INVENTION

Accordingly, one object of the present invention is to provide a mobileterminal and controlling method thereof that substantially obviates oneor more problems due to limitations and disadvantages of the relatedart.

Another object of the present invention is to provide a mobile terminaland controlling method thereof that displays object textual informationon the touchscreen identifying objects included within the preview imagebased on the obtained current position of the mobile terminal.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, thepresent invention provides in one aspect a mobile terminal including auser input unit configured to receive user-inputs; a wirelesscommunication unit configured to wirelessly communicate with at leastone other terminal; at least one camera configured to capture images; atouchscreen configured to display a camera preview image captured by thecamera; a position-location processor configured to obtain informationon a current position of the mobile terminal; and a controllerconfigured to search for textual object information corresponding to anobject within the camera preview image based on the current position ofthe mobile terminal, to control the camera to photograph the camerapreview image and to store the photographed camera preview image as apicture file, to output query information to query whether the searchedtextual object information is to be stored together with the picturefile, and to store the picture file with or without the searched textualobject information based on an answer to the output query information.

In another aspect, the present invention provides a method ofcontrolling a mobile terminal, and which includes allowing, via awireless communication unit, wirelessly communication with at least oneother terminal; capturing, via a camera, a camera preview image;displaying, on a touchscreen, the camera preview image; obtaining, via aposition-location processor, information on a current position of themobile terminal; searching, via a controller, for textual objectinformation corresponding to an object within the camera preview imagebased on the current position of the mobile terminal; photographing, viathe controller, the camera preview image; storing, via the controller,the photographed camera preview image as a picture file; outputting, viathe controller, query information to query whether the searched textualobject information is to be stored together with the picture file; andstoring, via the controller, the picture file with or without thesearched textual object information based on an answer to the outputquery information.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a block diagram of a mobile terminal according to oneembodiment of the present invention;

FIG. 2A is a front perspective diagram of a mobile terminal according toone embodiment of the present invention;

FIG. 2B is a rear perspective diagram of a mobile terminal according toone embodiment of the present invention;

FIG. 3 is a diagram of an environment for implementing a method ofcontrolling a mobile terminal according to an embodiment of the presentinvention;

FIG. 4 is a flowchart illustrating a method of controlling a mobileterminal according to an embodiment of the present invention;

FIGS. 5 and 6 are diagrams of display screen configurations forimplementing a method of controlling a mobile terminal according to anembodiment of the present invention;

FIG. 7 is a flowchart illustrating a method of controlling a mobileterminal according to an embodiment of the present invention;

FIG. 8 is a diagram of display screen configurations for implementing amethod of controlling a mobile terminal according to another embodimentof the present invention;

FIGS. 9 to 11 are diagrams of display screen configurations forimplementing a method of controlling a mobile terminal according to anembodiment of the present invention;

FIG. 12 is a diagram of display screen configurations for implementing amethod of controlling a mobile terminal according to yet anotherembodiment of the present invention;

FIGS. 13 and 14 are diagrams of display screen configurations forimplementing a method of controlling a mobile terminal according tostill another embodiment of the present invention;

FIG. 15 is a diagram of display screen configurations for implementing amethod of controlling a mobile terminal according to an embodiment ofthe present invention; and

FIGS. 16 and 17 are flowcharts illustrating a method of controlling amobile terminal according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

In the following detailed description, reference is made to theaccompanying drawing figures which form a part hereof, and which show byway of illustration specific embodiments of the invention. It is to beunderstood by those of ordinary skill in this technological field thatother embodiments may be utilized, and structural, electrical, as wellas procedural changes may be made without departing from the scope ofthe present invention. Wherever possible, the same reference numberswill be used throughout the drawings to refer to the same or like parts.

In addition, the suffixes ‘module’, ‘unit’ and ‘part’ are used forelements in order to facilitate the disclosure only. Therefore,significant meanings or roles are not given to the suffixes themselvesand it is understood that the ‘module’, ‘unit’ and ‘part’ can be usedtogether or interchangeably.

The present invention can also be applicable to a various types ofterminals. Examples of such terminals include mobile as well asstationary terminals, such as mobile phones, user equipment, smartphones, DTV, computers, digital broadcast terminals, personal digitalassistants, portable multimedia players (PMP) and navigators. However,by way of non-limiting example only, further description will be madewith regard to a mobile terminal 100, and it should be noted that suchteachings may apply equally to other types of terminals.

FIG. 1 is a block diagram of a mobile terminal 100 according to anembodiment of the present invention. As shown in FIG. 1, the mobileterminal 100 includes a wireless communication unit 110, an A/V(audio/video) input unit 120, a user input unit 130, a sensing unit 140,an output unit 150, a memory 160, an interface unit 170, a controller180, a power supply unit 190 and the like. FIG. 1 also shows the mobileterminal 100 having various components, but implementing all of theillustrated components is not a requirement. Greater or fewer componentsmay alternatively be implemented.

In addition, the wireless communication unit 110 generally includes oneor more components which permits wireless communication between themobile terminal 100 and a wireless communication system or networkwithin which the mobile terminal 100 is located. For instance, in FIG.1, the wireless communication unit 110 includes a broadcast receivingmodule 111, a mobile communication module 112, a wireless Internetmodule 113, a short-range communication module 114, a position-locationmodule 115 and the like.

The broadcast receiving module 111 receives a broadcast signal and/orbroadcast associated information from an external broadcast managingserver via a broadcast channel. In addition, the broadcast channel mayinclude a satellite channel and a terrestrial channel.

Further, the broadcast managing server generally refers to a serverwhich generates and transmits a broadcast signal and/or broadcastassociated information or a server which is provided with a previouslygenerated broadcast signal and/or broadcast associated information andthen transmits the provided signal or information to a terminal.

The broadcast signal may be implemented as a TV broadcast signal, aradio broadcast signal, and a data broadcast signal, among others. Ifdesired, the broadcast signal may further include a broadcast signalcombined with a TV or radio broadcast signal.

At least two broadcast receiving modules 111 can also be provided to themobile terminal 100 to simultaneously receive at least two broadcastchannels or broadcast channel switching facilitation. The broadcastassociated information includes information associated with a broadcastchannel, a broadcast program, a broadcast service provider, etc. Also,the broadcast associated information can be provided via a mobilecommunication network. In this instance, the broadcast associatedinformation can be received by the mobile communication module 112.

Further, the broadcast associated information can be implemented invarious forms. For instance, broadcast associated information mayinclude an electronic program guide (EPG) of the digital multimediabroadcasting (DMB) system and an electronic service guide (ESG) of thedigital video broadcast-handheld (DVB-H) system.

The broadcast receiving module 111 may also be configured to receivebroadcast signals transmitted from various types of broadcast systems.In a non-limiting example, such broadcasting systems include the digitalmultimedia broadcasting-terrestrial (DMB-T) system, the digitalmultimedia broadcasting-satellite (DMB-S) system, the digital videobroadcast-handheld (DVB-H) system, the DVB-CBMS system, the OMA-BCASTsystem, the data broadcasting system known as media forward link only(MediaFLO®) and integrated services digital broadcast-terrestrial(ISDB-T). Optionally, the broadcast receiving module 111 can beconfigured to be suitable for other broadcasting systems as well as theabove-explained digital broadcasting systems. The broadcast signaland/or broadcast associated information received by the broadcastreceiving module 111 can also be stored in a suitable device, such as amemory 160.

In addition, the mobile communication module 112 transmits/receiveswireless signals to/from one or more network entities (e.g., basestation, external terminal, server, etc.). Such wireless signals mayrepresent audio, video, and data according to text/multimedia messagetransceivings, among others.

Further, the wireless Internet module 113 supports Internet access forthe mobile terminal 100, and may be internally or externally coupled tothe mobile terminal 100. The wireless Internet technology can includeWLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (WorldInteroperability for Microwave Access), HSDPA (High Speed DownlinkPacket Access), etc. The mobile terminal 100 also accesses an externalserver provided with an object information database through a wirelessInternet access, searches the object information database for desiredobject information, and is then able obtain the object information.

In addition, the short-range communication module 114 facilitatesrelatively short-range communications. Suitable technologies forimplementing this module include radio frequency identification (RFID),infrared data association (IrDA), ultra-wideband (UWB), as well at thenetworking technologies commonly referred to as Bluetooth and ZigBee, toname a few.

Also, the position-location module 115 identifies or otherwise obtainsthe location of the mobile terminal 100. If desired, this module may beimplemented with a global positioning system (GPS) module. Further, theGPS module 115 can precisely calculate current 3-dimensional positioninformation based on at least one of a longitude, latitude and altitudeand direction (or orientation) by calculating distance information andprecise time information from at least three satellites and thenapplying triangulation to the calculated information. The location andtime information are calculated using three satellites, for example, anderrors of the calculated location position and time informations arethen amended using another satellite. The GPS module 115 can alsocalculate speed information by continuously calculating a real-timecurrent location.

Referring to FIG. 1, the audio/video (A/V) input unit 120 is configuredto provide audio or video signal input to the mobile terminal 100. Asshown, the A/V input unit 120 includes a camera 121 and a microphone122. The camera 121 receives and processes image frames of stillpictures or video, which are obtained by an image sensor in a video callmode or a photographing mode. The processed image frames can also bedisplayed on the display 151. Further, the image frames processed by thecamera 121 can be stored in the memory 160 or can be externallytransmitted via the wireless communication unit 110. Optionally, atleast two cameras 121 can be provided to the mobile terminal 100according to environment of usage.

In addition, the microphone 122 receives an external audio signal whilethe portable device is in a particular mode, such as phone call mode,recording mode and voice recognition. This audio signal is thenprocessed and converted into electric audio data. The processed audiodata is transformed into a format transmittable to a mobilecommunication base station via the mobile communication module 112 for acall mode. The microphone 122 can also include assorted noise removingalgorithms to remove noise generated in the course of receiving theexternal audio signal.

In addition, the user input unit 130 generates input data responsive touser manipulation of an associated input device or devices. Examples ofsuch devices include a keypad, a dome switch, a touchpad (e.g., staticpressure/capacitance), a jog wheel, a jog switch, etc. Further, thesensing unit 140 provides sensing signals for controlling operations ofthe mobile terminal 100 using status measurements of various aspects ofthe mobile terminal. For instance, the sensing unit 140 may detect anopen/close status of the mobile terminal 100, relative positioning ofcomponents (e.g., a display and keypad) of the mobile terminal 100, achange of position of the mobile terminal 100 or a component of themobile terminal 100, a presence or absence of user contact with themobile terminal 100, orientation or acceleration/deceleration of themobile terminal 100.

As an example, when the mobile terminal 100 is configured as aslide-type mobile terminal, the sensing unit 140 can sense whether asliding portion of the mobile terminal is opened or closed. Otherexamples include the sensing unit 140 sensing the presence or absence ofpower provided by the power supply 190, the presence or absence of acoupling or other connection between the interface unit 170 and anexternal device. In FIG. 1, the sensing unit 140 also includes aproximity sensor 141.

Further, the output unit 150 generates outputs relevant to the senses ofsight, hearing, touch and the like. The output unit 150 also includesthe display 151, an audio output module 152, an alarm unit 153, a hapticmodule 154, a projector module 155 and the like. In addition, thedisplay 151 is implemented to visually display or output informationassociated with the mobile terminal 100. For instance, if the mobileterminal is operating in a phone call mode, the display can provide auser interface (UI) or graphical user interface (GUI) which includesinformation associated with placing, conducting, and terminating a phonecall. As another example, if the mobile terminal 100 is in a video callmode or a photographing mode, the display 151 can additionally oralternatively display images which are associated with these modes, theUI or the GUI.

The display module 151 may be implemented using display technologiesincluding, for example, a liquid crystal display (LCD), a thin filmtransistor-liquid crystal display (TFT-LCD), an organic light-emittingdiode display (OLED), a flexible display and a three-dimensionaldisplay. The mobile terminal 100 may also include one or more of suchdisplays.

Some of the above displays can be implemented in a transparent oroptical transmittive type, which are referred to as a transparentdisplay. As a representative example for the transparent display, thereis TOLED (transparent OLED) or the like. A rear configuration of thedisplay 151 can be implemented in the optical transmittive type as well.In this configuration, a user is able to see an object in rear of aterminal body via the area occupied by the display 151 of the terminalbody.

At least two displays 151 can also be provided to the mobile terminal100 in accordance with the implemented configuration of the mobileterminal 100. For instance, a plurality of displays can be arranged on asingle face of the mobile terminal 100 in a manner of being spaced apartfrom each other or being built in one body. Alternatively, a pluralityof displays can be arranged on different faces of the mobile terminal100.

When the display 151 and a sensor for detecting a touch action(hereinafter called ‘touch sensor’) configures a mutual layer structure(hereinafter called ‘touchscreen’), the display 151 can be as an inputdevice as well as an output device. In this instance, the touch sensorcan be configured as a touch film, a touch sheet, a touchpad or thelike.

Further, the touch sensor can be configured to convert a pressureapplied to a specific portion of the display 151 or a variation of acapacitance generated from a specific portion of the display 151 to anelectric input signal. Moreover, the touch sensor can also be configuredto detect a pressure of a touch as well as a touched position or size.

In addition, if a touch input is made to the touch sensor, signal(s)corresponding to the touch is transferred to a touch controller. Thetouch controller then processes the signal(s) and transfers theprocessed signal(s) to the controller 180. Therefore, the controller 180can determine whether a prescribed portion of the display 151 istouched.

Referring to FIG. 1, the proximity sensor 141 can be provided to aninternal area of the mobile terminal 100 enclosed by the touchscreen oraround the touchscreen. The proximity sensor 141 can also detect apresence or non-presence of an object approaching a prescribed detectingsurface or an object existing around the proximity sensor using anelectromagnetic field strength or infrared ray without mechanicalcontact. Hence, the proximity sensor 141 has durability longer than thatof a contact type sensor and also has utility wider than that of thecontact type sensor.

The proximity sensor 141 can include one of a transmittive photoelectricsensor, a direct reflective photoelectric sensor, a mirror reflectivephotoelectric sensor, a radio frequency oscillation proximity sensor, anelectrostatic capacity proximity sensor, a magnetic proximity sensor, aninfrared proximity sensor and the like. Also, when the touchscreenincludes the electrostatic capacity proximity sensor, the proximitysensor 141 can detect the proximity of a pointer using a variation ofelectric field according to the proximity of the pointer. In thisinstance, the touchscreen (touch sensor) can be classified as theproximity sensor.

In the following description, for clarity, an action that a pointerapproaches without contacting with the touchscreen to be recognized aslocated on the touchscreen is named ‘proximity touch’. In addition, anaction that a pointer actually touches the touchscreen is named ‘contacttouch’. The meaning of the position on the touchscreen proximity-touchedby the pointer means the position of the pointer which verticallyopposes the touchscreen when the pointer performs the proximity touch.

The proximity sensor 141 also detects a proximity touch and a proximitytouch pattern (e.g., a proximity touch distance, a proximity touchduration, a proximity touch position, a proximity touch shift state,etc.). Also, information corresponding to the detected proximity touchaction and the detected proximity touch pattern can be output to thetouchscreen.

Further, the audio output module 152 functions in various modesincluding a call-receiving mode, a call-placing mode, a recording mode,a voice recognition mode, a broadcast reception mode and the like tooutput audio data which is received from the wireless communication unit110 or is stored in the memory 160. During operation, the audio outputmodule 152 outputs audio relating to a particular function (e.g., a callreceived, message received, etc.). The audio output module 152 can alsobe implemented using one or more speakers, buzzers, other audioproducing devices, and combinations thereof.

The alarm unit 153 outputs a signal for announcing the occurrence of aparticular event associated with the mobile terminal 100. Typical eventsinclude a call received event, a message received event and a touchinput received event. The alarm unit 153 can also output a signal forannouncing the event occurrence by way of vibration as well as video oraudio signal. Further, the video or audio signal can be output via thedisplay 151 or the audio output unit 152. Hence, the display 151 or theaudio output module 152 can be regarded as a part of the alarm unit 153.

In addition, the haptic module 154 generates various tactile effectsthat can be sensed by a user. Vibration is a representative one of thetactile effects generated by the haptic module 154. The strength andpattern of the vibration generated by the haptic module 154 can also becontrolled. For instance, different vibrations can be output in a mannerof being synthesized together or can be output in sequence.

The haptic module 154 can also generate various tactile effects as wellas the vibration. For instance, the haptic module 154 generates theeffect attributed to the arrangement of pins vertically moving against acontact skin surface, the effect attributed to the injection/suctionpower of air though an injection/suction hole, the effect attributed tothe skim over a skin surface, the effect attributed to the contact withelectrode, the effect attributed to the electrostatic force, the effectattributed to the representation of hold/cold sense using an endothermicor exothermic device and the like.

The haptic module 154 can also be implemented to enable a user to sensethe tactile effect through a muscle sense of finger, arm or the like aswell as to transfer the tactile effect through a direct contact.Optionally, at least two haptic modules 154 can be provided to themobile terminal 100 in accordance with the corresponding configurationtype of the mobile terminal 100.

In addition, the projector module 155 performs an image projectorfunction using the mobile terminal 100. in more detail, the projectormodule 155 can display an image, which is identical to or partiallydifferent at least from the image displayed on the display 151, on anexternal screen or wall according to a control signal of the controller180.

In particular, the projector module 155 can include a light source forgenerating light (e.g., a laser) for externally projecting an image, animage producing mechanism for producing and externally outputting anusing the light generated from the light source, and a lens forenlarging and outputting the image externally in a predetermined focusdistance. In addition, the projector module 155 can further include adevice for adjusting an image projected direction by mechanically movingthe lens or the whole module.

Further, the projector module 155 can be classified into a CRT (cathoderay tube) module, an LCD (liquid crystal display) module, a DLP (digitallight processing) module or the like according to a device type of adisplay. In particular, the DLP module is operated by the mechanism ofenabling the light generated from the light source to reflect on a DMD(digital micro-mirror device) chip and can be advantageous for thedownsizing the projector module 151. Preferably, the projector module155 can be provided in a length direction of a lateral, front orbackside direction of the mobile terminal 100. However, the projectormodule 155 can also be provided to any portion of the mobile terminal100.

In addition, the memory 160 can store various types of data to supportthe processing, control, and storage requirements of the mobile terminal100. Examples of such data include program instructions for applicationsoperating on the mobile terminal 100, contact data, phonebook data,messages, audio, still pictures (or photo), moving pictures, etc. Arecent use history or a cumulative use frequency of each data (e.g., usefrequency for each phonebook, each message or each multimedia) can alsobe stored in the memory 160. Moreover, data for various patterns ofvibration and/or sound output for a touch input to the touchscreen canbe stored in the memory 160.

The memory 160 can also store a database relating to object informationof an object (e.g., a building, shop, milestone, etc.) that can besearched using at least one of shape recognizing information related tothe object within an image photographed by the camera and positioninformation of the mobile terminal 100 obtained through theposition-location module 115. The object information can include atleast one of relevant text information (e.g., a name of the building, aname of the shop, etc.), relevant link information (e.g., web linkinformation of the building, link information of the shop, etc.),relevant image information (e.g., an image logo of the building, animage logo of the shop, etc.) and audio information (e.g., a logo songof the building, a logo song of the shop, etc.) of the shape recognizedobject. The above-noted object information are examples only and othertypes of object information can be displayed.

Further, the database stored in the memory 160 can be updated ordownloaded from a database of an external server via the wirelesscommunication unit. The database of the memory 160 can also include thedata constructed in a manner of downloading every part of the databaseof the external server. Alternatively, the database of the memory 160can include the data constructed in a manner of downloading a portion ofthe database of the external server in consideration of the capacity ofthe memory 160. Further, the portion of the database of the externalserver may be provided for an object located within a predetermineddistance from a current location of the terminal or may be provided foran object located in a predetermined area (e.g., an administrativedistrict) related to the current location of the terminal.

In addition, the memory 160 may be implemented using any type orcombination of suitable volatile and non-volatile memory or storagedevices including hard disk, random access memory (RAM), static randomaccess memory (SRAM), electrically erasable programmable read-onlymemory (EEPROM), erasable programmable read-only memory (EPROM),programmable read-only memory (PROM), read-only memory (ROM), magneticmemory, flash memory, magnetic or optical disk, multimedia card microtype memory, card-type memory (e.g., SD memory, XD memory, etc.), orother similar memory or data storage device. The mobile terminal 100 canalso operate in association with a web storage for performing a storagefunction of the memory 160 on Internet.

Further, the interface unit 170 is used to couple the mobile terminal100 with external devices. The interface unit 170 receives data from theexternal devices or is supplied with the power and then transfers thedata or power to the respective elements of the mobile terminal 100 orenables data within the mobile terminal 100 to be transferred to theexternal devices. The interface unit 170 may also be configured using awired/wireless headset port, an external charger port, a wired/wirelessdata port, a memory card port, a port for coupling to a device having anidentity module, audio input/output ports, video input/output ports, anearphone port and/or the like.

In addition, the identity module is the chip for storing various typesof information for authenticating a use authority of the mobile terminal100 and can include a User Identify Module (UIM), Subscriber IdentifyModule (SIM), Universal Subscriber Identity Module (USIM) and/or thelike. A device having the identity module (hereinafter called ‘identitydevice’) can be manufactured as a smart card. Therefore, the identitydevice is connectable to the mobile terminal 100 via the correspondingport.

Further, when the mobile terminal 110 is connected to an externalcradle, the interface unit 170 becomes a passage for supplying themobile terminal 100 with power from the cradle or a passage fordelivering various command signals input from the cradle by a user tothe mobile terminal 100. Each of the various command signals input fromthe cradle or the power can operate as a signal enabling the mobileterminal 100 to recognize that it is correctly loaded in the cradle.

Further, the controller 180 controls the overall operations of themobile terminal 100. For example, the controller 180 performs thecontrol and processing associated with voice calls, data communications,video calls, etc. In FIG. 1, the controller 180 includes a multimediamodule 181 that provides multimedia playback. The multimedia module 181may be configured as part of the controller 180 or be implemented as aseparate component.

Moreover, the controller 180 can perform a pattern (that is, shape orimage) recognizing process for recognizing a writing input and a picturedrawing input performed on the touchscreen as characters or images,respectively. The controller 180 can also identify a prescribed imagepart of a prescribed image (e.g., a camera preview image, a play image)through the shape recognizing processing.

Meanwhile, the controller 180 can be configured to implement augmentedreality (abbreviated AR or named enhanced reality). The augmentedreality is a sort of virtual reality that combines a real world seenthrough the user's eyes and a virtual world having side information intoone image. Namely, the augmented reality, which complements a real worldwith a virtual world, plays a role in providing information necessaryfor the real world additionally using graphics. The controller 180 canalso display the object information in form of the augmented reality.

In FIG. 1, the controller 180 also includes an object information module182 for the processing related to a display of the object information.Further, the object information module 182 can be implemented within thecontroller 180 or be being separated from the controller 180. Inaddition, the power supply unit 190 provides power required by thevarious components for the mobile terminal 100. The power may beinternal power, external power, or combinations thereof.

Also, various embodiments described herein may be implemented in acomputer-readable medium using, for example, computer software,hardware, or some combination thereof. For a hardware implementation,the embodiments described herein may be implemented within one or moreapplication specific integrated circuits (ASICs), digital signalprocessors (DSPs), digital signal processing devices (DSPDs),programmable logic devices (PLDs), field programmable gate arrays(FPGAs), processors, controllers, micro-controllers, microprocessors,other electronic units designed to perform the functions describedherein, or a selective combination thereof. Such embodiments may also beimplemented by the controller 180.

For a software implementation, the embodiments described herein may beimplemented with separate software modules, such as procedures andfunctions, each of which perform one or more of the functions andoperations described herein. The software codes can be implemented witha software application written in any suitable programming language andmay be stored in memory such as the memory 160, and executed by acontroller or processor, such as the controller 180.

Turning next to FIG. 2A, a front perspective diagram of the mobileterminal 100 according to one embodiment of the present invention isshown. The mobile terminal 100 shown in the drawing has a bar typeterminal body. However, the mobile terminal 100 may be implemented in avariety of different configurations. Examples of such configurationsinclude a folder-type, slide-type, rotational-type, swing-type andcombinations thereof. For clarity, further disclosure will primarilyrelate to a bar-type mobile terminal 100. However such teachings applyequally to other types of mobile terminals.

Referring to FIG. 2A, the mobile terminal 100 includes a case (casing,housing, cover, etc.) configuring an exterior thereof. In the presentembodiment, the case is divided into a front case 101 and a rear case102. Various electric/electronic parts are also loaded in a spaceprovided between the front and rear cases 101 and 102. Optionally, atleast one middle case can be further provided between the front and rearcases 101 and 102. The cases 101 and 102 can also be formed by injectionmolding of synthetic resin or can be formed of metal substance such asstainless steel (STS), titanium (Ti) or the like for example.

The display 151, the audio output unit 152, the camera 121, user inputunits 130/131 and 132, the microphone 122, the interface 180 and thelike can also be provided to the terminal body, and more particularly,to the front case 101. Further, as shown, the display 151 occupies mostof a main face of the front case 101, and the audio output unit 151 andthe camera 121 are provided to an area adjacent to one of both endportions of the display 151. Also, the user input unit 131 and themicrophone 122 are provided to another area adjacent to the other endportion of the display 151. The user input unit 132 and the interface170 are also provided to lateral sides of the front and rear cases 101and 102.

In addition, the input unit 130 is manipulated to receive a command forcontrolling an operation of the terminal 100. Further, the input unit130 in this example includes a plurality of manipulating units 131 and132. The manipulating units 131 and 132 can thus be referred to as amanipulating portion and may adopt any mechanism of a tactile mannerthat enables a user to perform a manipulation action by experiencing atactile feeling.

In addition, content input by the first or second manipulating units 131or 132 can be diversely set. For instance, such a command as start, end,scroll and the like can be input to the first manipulating unit 131, anda command for a volume adjustment of sound output from the audio outputunit 152, a command for a switching to a touch recognizing mode of thedisplay 151 or the like can be input to the second manipulating unit132.

Next, FIG. 2B is a perspective diagram of a backside of the terminalshown in FIG. 2A. Referring to FIG. 2B, a camera 121′ can beadditionally provided to a backside of the terminal body, and moreparticularly, to the rear case 102. The camera 121′ also has aphotographing direction that is substantially opposite to that of thecamera 121 shown in FIG. 2A and may have pixels differing from those ofthe firmer camera 121.

Preferably, for instance, the camera 121 has low pixels enough tocapture and transmit a picture of user's face for a video call, whilethe camera 121′ has high pixels for capturing a general subject forphotography without transmitting the captured subject. Also, each of thecameras 121 and 121′ can be installed at the terminal body to be rotatedor popped up. Also, the camera 121′ of the rear case 102 can be used fora video call.

In addition, a flash 123 and a mirror 124 are additionally providedadjacent to the camera 121′. The flash 123 projects light toward asubject when photographing the subject using the camera 121′. When theuser attempts to take a picture of the user (self-photography) using thecamera 121′, the mirror 124 allows the user to view user's facereflected by the mirror 124. An additional audio output unit 152′ canalso be provided to the backside of the terminal body. The additionalaudio output unit 152′ can thus implement a stereo function togetherwith the former audio output unit 152 shown in FIG. 2A and may be usedfor implementation of a speakerphone mode.

Further, as shown in FIG. 2B, a broadcast signal receiving antenna 124can be additionally provided to the lateral side of the terminal body aswell as an antenna for communication or the like. The antenna 124constructing a portion of the broadcast receiving module 111 shown inFIG. 1 can be retractably provided to the terminal body. The powersupply unit 190 for supplying power to the terminal 100 is also providedto the terminal body. Further, the power supply unit 190 can beconfigured to be built within the terminal body or be detachablyconnected to the terminal body.

A touchpad 135 for detecting a touch can also be provided to the rearcase 102. The touchpad 135 can be configured in a light transmittivetype like the display 151. In this instance, if the display 151 isconfigured to output visual information from both faces, the display 151can recognize the visual information via the touchpad 135 as well. Theinformation output from both of the faces can also be entirelycontrolled by the touchpad 135. Alternatively, a display can be providedto the touchpad 135 so that a touchscreen can be provided to the rearcase 102 as well.

In addition, the touchpad 135 is activated by interconnecting with thedisplay 151 of the front case 101. The touchpad 135 can also be providedin rear of the display 151 in parallel, and can have a size equal to orsmaller than that of the display 151.

In the following description of the embodiments, the display 151includes a touchscreen, which is indicated by a reference number 400. Anenvironment for implementing a method of controlling a mobile terminalaccording to an embodiment of the present invention will now beexplained with reference to FIG. 3.

In particular, FIG. 3 is a diagram of an environment for implementing amethod of controlling a mobile terminal according to an embodiment ofthe present invention. Referring to FIG. 3, the mobile terminal 100 canphotograph a peripheral image as a preview image (hereinafter called‘camera preview image’) using the camera 121. The mobile terminal 100 isthen able to display the camera preview image on the touchscreen 400.

Further, the mobile terminal 100 can receive position information suchas a latitude, a longitude, an altitude and a direction of the mobileterminal 100 from the position-location module 115. The controller 180then identifies an object included in the camera preview image using atleast one of the position information and shape recognizing informationof the camera preview image and displays information on the object(i.e., object information) on the touchscreen 400.

Next, FIG. 4 is a flowchart illustrating a method of controlling amobile terminal according to an embodiment of the present invention, andFIG. 5 and FIG. 6 are diagrams of display screen configurations forimplementing a method of controlling a mobile terminal according to anembodiment of the present invention.

Referring to FIG. 4 and (5-1) of FIG. 5, the camera preview image isdisplayed on the touchscreen 400 (S41). Further, the controller 180obtains current position information of the mobile terminal 100 via theposition location module 115 (S42). Optionally, the steps S41 and S42can be performed simultaneously or in reverse order.

The controller 180 then determines whether object informationcorresponding to at least one object exists within the camera previewimage using at least one of the obtained current position informationand shape recognizing information of the camera preview image (S43). Ifthe corresponding object information does not exist within the camerapreview image (No in S43), the controller 180 continuously orperiodically obtains the current position information of the mobileterminal 100 to recognize whether the mobile terminal 100 is moving.

In addition, the object information can be downloaded from an externalserver, for example, or can be maintained in the memory of the mobileterminal. The controller 180 can also use the obtained location of themobile terminal to search the external server or memory of the terminalto determine objects that exist within or near the obtained location ofthe terminal. The controller 180 can also use shapes of the objects inthe preview image to determine if the shapes match any objectinformation existing in the external server or memory, for example.Thus, the controller 180 can determine objects that exist within thepreview image, search the memory or external server for objectinformation that matches the objects, and then provide objectinformation to the user. The object information can also be periodicallydownloaded from the server and stored in the memory as the location ofthe mobile terminal changes. The user can also select a predeterminedoption requesting object information be downloaded from a server.

Referring to FIG. 4 and (5-2) of FIG. 5, if the corresponding objectinformation (OI) exists within the camera preview image (Yes in S43),the controller 180 displays object information presence indicator 410indicating that the corresponding object exists on the touchscreen(S44). This indication of the presence of the corresponding objectinformation can be provided to a terminal user in one of various typesand/or methods different from (5-2) of FIG. 5. This will be explained inmore detail later.

Subsequently, an object information display function for displaying theobject information on the touchscreen 400 can be activated in the mobileterminal 100 (S45). Further, there are various methods of activating theobject information display function. This will be explained in moredetail later.

Referring to (5-3) of FIG. 5, the controller 180 displays an objectinformation display function activation indicator 420 indicating thatthe object information display function has been activated on thetouchscreen 400. When the object information is not displayed in thecamera preview image, the terminal user can easily recognize that theobject information is not displayed because object information does notexist in the camera preview image or because the object informationdisplay function is not activated despite the presence of the objectinformation in the camera preview image.

Also, (5-3) of FIG. 5 illustrates that two objects (i.e., a first objectand a second object) exist in the camera preview image displayed on thetouchscreen. However, this is an example only, and the presentembodiment is not limited to this example. For example, one object or atleast three or more objects can exist in the camera preview image.

In addition, as shown in (5-3) of FIG. 5, the controller 180 displays afirst object display indicator 513 and a first object information 515corresponding to the first object, and displays a second object displayindicator 523 and a second object information 525 corresponding to thesecond object. Optionally, the object information can be displayed onlywithout displaying the object display indicator. Further, the objectdisplay indicator is recognized as a part of the object information toplay a role as one object information. Moreover, the object displayindicator can mean the object information. Thus, as shown in (5-3) ofFIG. 5, the user can see that a Starbucks and LG Electronics are withinthe preview image.

Various types and/or methods of indicating that the corresponding objectinformation exists will now be further explained with reference to FIG.6. Referring to (6-1) of FIG. 6, the mobile terminal 100 allows aterminal user to be aware that the corresponding object informationexists by generating vibration if the corresponding object informationexists.

Referring to (6-2) of FIG. 6, the mobile terminal 100 allows a terminaluser to be aware that the corresponding object information exists bydisplaying the first object display indicator 513 and the second objectdisplay indicator 523 for objects respectively in the camera previewimage displayed on the touchscreen 400 (e.g., in this example, theoutline of the objects are highlighted). In this instance, the objectdisplay indicator can play a role as the object information presenceindicator.

Next, various methods for activating the object information displayfunction in the mobile terminal 100 will be explained. First of all, aterminal user is able to activate the object information displayfunction via a proper key manipulation of the user input unit 130. Thisis apparent to those of ordinary skill in this technological fieldwithout separate explanation and thus its details will be omitted fromthe following description.

In another example, the user can shake the mobile terminal 100 to havethe controller 180 activate the object information display function. Instill another example, the user can touch a specific part of thetouchscreen 400 (e.g., the object information presence indicator 410) toactivate the object information display function.

Further, in another example, if object information exists on an objectlocated within a predetermined distance from a current location of theterminal, the controller 180 can automatically activate the objectinformation display function. In addition, after the object informationdisplay function has been activated, and as the mobile terminal moves sothat corresponding object information does not exist within thepredetermined distance, the controller 180 can automatically deactivatethe object information display function.

Next, FIGS. 7 and 8 illustrate an alternative embodiment of informingthe user of the presence of object information. In particular, FIG. 7 isa flowchart illustrating a method of controlling a mobile terminalaccording to an embodiment of the present invention, and FIG. 8 is adiagram of display screen configurations for implementing a method ofcontrolling a mobile terminal according to an embodiment of the presentinvention.

Referring to FIG. 7 and (8-1) of FIG. 8, the controller 180 displays acamera preview image on the touchscreen 400 (S71). Then, the usertouches one object in the camera preview image (S72). The controller 180then obtains current position information of the mobile terminal 100 viathe position location module 115 (S73).

Further, the steps S73 and S71 can be performed simultaneously.Alternatively, the step S73 can be performed before the step S71 orbetween the steps S71 and S72. Alternatively, the steps S73 and S72 canbe simultaneously performed.

Then, the controller 180 determines whether object informationcorresponding to the touched object exists using at least one of theobtained current position information and the shape recognizinginformation of the camera preview image (S74). If the informationcorresponding to the touched object does not exist (No in S74), thecontroller 180 continuously or periodically determines whether anotherobject within the camera preview image is touched.

If the information corresponding to the touched object exists (Yes inS74), the controller 180 activates the object information displayfunction (S75). Therefore, referring to (8-2) of FIG. 8, the controller180 displays the object display indicator 513 and the object information515 corresponding to the touched object in the camera preview imagedisplayed on the touchscreen 400 (S76).

As mentioned in the foregoing description with reference to (5-3) ofFIG. 5, if at least two objects exist within the camera preview image,object information corresponding to the at least two objects existingwithin the camera preview image can be simultaneously displayed, bywhich the present embodiment is non-limited. Further, the correspondingobject informations can be configured in a manner of being displayed oneby one, which will now be explained in more detail with reference toFIGS. 9 to 11.

In FIGS. 9 to 11 are diagrams of display screen configurations forimplementing a method of controlling a mobile terminal according to anembodiment of the present invention. In addition, the followingdescription of FIGS. 9 to 11 is made on the assumption that two objects,i.e., a first object and a second object exist within the camera previewimage. However, as discussed above, three or more objects can also existwithin the camera preview image.

Referring to (9-1) of FIG. 9, the controller 180 displays the firstobject display indicator 513 and the second object display indicator 523within the camera preview image displayed on the touchscreen 400corresponding to a first object and a second object, respectively. Thesecond object or the second object display indicator 523 can be touchedwith such a pointer as a finger, a stylus pen and the like. If so,referring to (9-2) of FIG. 9, the controller 180 displays a secondobject information 525 corresponding to the second object in the camerapreview image to correspond to the second object.

Subsequently, the first object for the first object display indicator513 can be touched. If so, referring to (9-3) of FIG. 9, the controller180 removes the second object information 525 from the camera view imageand displays the first object information 515 corresponding to the firstobject. In addition, rather than removing the second object information525 if the first object or the first object display indicator istouched, the controller 180 can display the second object information525 together with the first object information 515. In this instance,the controller 180 can remove the second object information 525 if oneof the second object, the second object display indicator 523 and thesecond object information 525 is touched.

Referring to (10-1) of FIG. 10, the controller displays the first objectdisplay indicator 513 and the first object information 515, whichcorrespond to a first object closest to a current position of theterminal, in a camera preview image displayed on the touchscreen 400.The user can then input a first prescribed user command via the userinput unit 130 such as a touch & drag or a flicking operation in aprescribed direction on the touchscreen 400. Alternatively, thecontroller 180 can determine that a prescribed period of time passesafter the first object display indicator 513 and the first objectinformation 515 have been displayed.

If so, referring to (10-2) of FIG. 10, the controller 180 removes thefirst object display indicator 513 and the first object information 515from the camera preview image displayed on the touchscreen 400, anddisplays the second object display indicator 523 and the second objectinformation 525, which correspond to the second object second closest tothe current position of the terminal, in a camera preview imagedisplayed on the touchscreen 400.

If a second prescribed user command is input via the user input unit 130or a prescribed period of time passes again, the controller 180 canremove the second object display indicator 523 and the second objectinformation 525 and display the first object display indicator 513 andthe first object information 515. In addition, the second prescribeduser command may be equal to or different from the first prescribed usercommand. For instance, the second prescribed user command can include atouch & drag operation in a direction opposite to the prescribeddirection on the touchscreen 400.

Further, the controller 180 does not have to display the objectinformation corresponding to the object closest to the current positionof the terminal. For example, the controller 180 can display objectioninformation of an object located at a specific position (e.g., a mostcenter position) within the camera preview image. Then, when, the userinputs a touch & drag operation, for example, in a prescribed direction(e.g., a right direction) on the touchscreen 400, the controller 180 candisplay corresponding object information of another object located rightnext or adjacent to the former object in the prescribed direction (e.g.,the object located to the right side of the former object).

Next, referring to (11-1) of FIG. 11, the controller 180 can display adistance indicator bar 430 indicating a prescribed distance related toan object information display set by a terminal user on the touchscreen400. Further, the following description refers to the prescribeddistance as a first distance. If so, the controller 180 displays thefirst object display indicator 513 of the first object, which is locatedwithin the first distance from a current position of the terminal, andthe first object information 515 on the first object in a camera previewimage displayed on the touchscreen 400.

As mentioned in the foregoing description, if the database of the memory160 is the portion of the database downloaded from the external server,the database of the memory 160 may be only for objects within the firstdistance from the current position. Subsequently, the user can input auser command via the user input unit 130. For example, the user commandcan be performed in a manner that the distance indicator bar 430displayed on the touchscreen 400 is touched with a pointer or finger andthen dragged.

If so, the prescribed distance is adjusted into a second distance fromthe first distance. In this example, the second distance is greater thanthe first distance. If the database of the memory 160 is the portion ofthe database downloaded from the external server, the controller 180 canupdate the database of the memory 160 for the objects within the seconddistance from the external server.

Subsequently, the controller 180 can search the objects located withinthe second distance. Referring to (11-2) of FIG. 11, the controller 180can display the first object display indicator 513 and first objectinformation 515 of the first object, which is located within the seconddistance from a current position of the terminal, and the second objectdisplay indicator 523 and second object information 525 of the secondobject, which is located within the second distance from the currentposition of the terminal, in the camera preview image displayed on thetouchscreen 400.

In particular, once a prescribed distance is determined by a terminaluser, the controller 180 can display object information on objectslocated within the prescribed distance. Meanwhile, when the user commandis input, referring to (11-3) of FIG. 11, the controller 180 can controlthe camera preview image to be zoomed in or out according to theadjusted second distance. As the prescribed distance increases from thefirst distance to the second distance, as shown in (11-3) of FIG. 11,the camera preview image zoomed out for example. Further, as theprescribed distance decreases to the first distance from the seconddistance, the camera preview image, as shown in (11-1) of FIG. 11, canbe zoomed in as well.

In the following description, a situation that the object informationincludes relevant link information is explained with reference to FIG.12. In particular, FIG. 12 is a diagram of display screen configurationsfor implementing a method of controlling a mobile terminal according toan embodiment of the present invention.

Referring to (12-1) of FIG. 12, the controller 180 can display theobject information 515 and 525 including relevant link information in acamera preview image displayed on the touchscreen 400. Further, toemphasize that the object information has the relevant link informationin (12-1) of FIG. 12, the controller 180 can display corresponding linkinformation as the object information in the camera preview image.

Then, the user can select one of the object information 515 and 525 bytouching the object information. In FIG. 12, the user has selectedobject information 525. If so, referring to (12-2) of FIG. 12, thecontroller 180 can display a webpage Internet-accessed according to thecorresponding link information of the touched object information 525 onthe touchscreen 400. When the webpage is displayed, the controller 180can also reduce power consumption caused by the object informationmodule by deactivating the object information module.

The above-mentioned object information can also be classified intoseveral categories according to their attributes, and the objectinformation belonging to a specific one of the categories can be sortedout and displayed. These additional features will now be explained withreference to FIGS. 13 and 14. In particular, FIGS. 13 and 14 arediagrams of display screen configurations for implementing a method ofcontrolling a mobile terminal according to an embodiment of the presentinvention. In FIGS. 13 and 14, all three objects, i.e., first to thirdobjects are assumed to exist in the camera view image.

Referring to (13-1) of FIG. 13, the controller 180 displays a list ofcategories of objects on the touchscreen 400. In FIG. 13, the categoriesinclude a ‘restaurant’ category 443, a ‘tour’ category 445, a ‘shopping’category 447, a ‘hospital’ category 449 and an ‘all’ category 441including all categories. Further, the categories are non-limited by theabove-enumerated five categories.

In addition, (13-1) of FIG. 13 illustrates the user selecting the ‘all’category 441. Therefore, the controller 180 displays the first to thirdobject informations 515, 525 and 535 respectively corresponding to firstto third objects in the camera preview image (i.e., displays all objectinformation).

Referring to (13-2) of FIG. 13, the user has selected the ‘restaurant’category 443, and thus the controller 180 displays the first objectinformation 515 corresponding to the selected ‘restaurant’ category 443.Further, (13-3) of FIG. 13 illustrates the user selecting the ‘tour’category 445, and the controller 180 displaying the third objectinformation 535 corresponding to the selected ‘tour’ category 445 in thecamera preview image. The user can also select the different categoriesby touching the categories or by operating particular keys on theterminal.

Referring to (14-1) of FIG. 14, the controller 180 displays the camerapreview image on the touchscreen 400. In this instance, the controller180 recognizes categories of objects existing within the camera previewimage using at least one of the obtained current position informationand the shape recognizing information of the camera preview image.Subsequently, referring to (14-2) of FIG. 14, the controller 180displays the recognized categories 443, 445 and 447. The user can thenselect one category from the displayed categories. Referring to (14-3)of FIG. 14, the controller 180 displays at least one object information535 belonging to the selected category in the camera preview imagedisplayed on the touchscreen 400.

In the following description, a method of displaying an objectinformation corresponding to an input keyword will be explained withreference to FIG. 15. In particular, FIG. 15 is a diagram of displayscreen configurations for implementing a method of controlling a mobileterminal according to yet another embodiment of the present invention.

Referring to (15-1) of FIG. 15, the controller 180 displays a camerapreview image on the touchscreen 400. The user can then input aprescribed user command via a proper manipulation of the user input unit130. The user command can be performed by touching the touchscreen 400,for example.

If so, referring (15-2) of FIG. 15, the controller 180 displays a textinput box 451 for a prescribed keyword input and a search execute icon453 on the touchscreen 400. The user can then input a prescribed keywordinput on the touchscreen 400 (e.g., by writing the keyword on thetouchscreen as shown in (15-2) of FIG. 15). The controller 180 thenrecognizes the text of the written keyword and inputs the correspondingtext to the text input box 451.

The user can then select the search execute icon 453. Then, if an objecthaving an object information corresponding to the input keyword existswithin the camera preview image, the controller 180 displays the objectinformation 525 as shown in (15-3) of FIG. 15. In particular, (15-3) ofFIG. 15 illustrates the controller 180 displaying the second objectdisplay indicator 523 and the second object information 525.

If the object having the object information corresponding to the inputkeyword does not exist within the camera preview image, the controller180 displays a direction indicator 455, which indicates a direction formoving the mobile terminal 100 to enable the object having the objectinformation to appear in the camera preview image on the touchscreen 400as shown in (15-4) of FIG. 15.

The foregoing descriptions explain how to display the object informationin the camera preview information. The following description explainshow to store the camera preview image in the memory 160 with referenceto FIGS. 16 and 17. In particular, FIGS. 16 and 17 are flowchartsillustrating a method of controlling a mobile terminal according to yetanother embodiment of the present invention.

Referring to FIG. 16, the controller 180 displays a prescribed camerapreview image on the touchscreen 400 (S161). Also, for the camerapreview image to be photographed and stored as a picture file throughproper manipulations of the user input unit 130, the terminal userinputs an image photograph command (i.e., a shutter command) (S162).Further, the picture file can include a moving picture file or a stillimage picture file.

Then, the controller 180 displays a guide window, which queries whetherobject information corresponding to at least one or more objects withinthe camera preview image will be stored together on the touchscreen 400(S163). If the terminal user does not attempt to store the objectinformation together through a proper manipulation of the user inputunit 130 (No in S163), the controller 180 stores the photographed camerapreview image only without the object informations (S164).

If the terminal user attempts to store the object information togetherthrough a proper manipulation of the user input unit 130 (Yes in S163),the controller displays a guide window for querying whether the objectinformation will be stored by being synthesized with the photographedcamera preview image (S165). If the terminal user attempts to store theobject information by having them synthesized with the camera previewimage through a proper manipulation of the user input unit (Yes inS165), the controller 180 synthesizes the object informations and thecamera preview image together into one picture file and then stores thepicture file (S166).

If the terminal user does not attempt to store the object informationsby having them synthesized with the camera preview image through aproper manipulation of the user input unit (No in S165), the controller180 stores the camera preview image as a picture file in a manner thatthe object information is separated as a separate file linked to thepicture file (S167). Therefore, when the picture file is played and/ordisplayed in the mobile terminal 100, the object information can be alsodisplayed according to a selection made by the terminal user.

Referring to FIG. 17, the controller 180 displays a prescribed camerapreview image on the touchscreen 400 (S171). Also, for the camerapreview image to be photographed and stored as a picture file throughproper manipulations of the user input unit 130, the terminal userinputs an image photograph command (i.e., a shutter command) (S172).

The controller 180 then generates an identifier using a current timeinformation on photographing the camera preview image in order toidentify the photographed camera preview image from other images andthen assigns the generated identifier to the stored picture file (S173).Further, the identifier can be assigned as a file name of the picturefile or as a tag information of the picture file. In the picture file, aposition information of the mobile terminal located in photographing thecamera preview image can also be stored as a tag.

Subsequently, after the camera preview image has been photographed andwhen a user command for playing back the stored picture file is input,the mobile terminal 100 transmits the identifier of the stored picturefile and the position information to an external server 300 having anobject information database via the wireless communication unit 110(S174). If necessary, the mobile terminal 100 can also transmit otherinformation (e.g., the shape recognizing information of the previewimage) required for the external server 300 to search for the objectinformation corresponding to the photographed preview image to theexternal server together with the identifier and the positioninformation.

Subsequently, the mobile terminal 100 receives the searched objectinformation from the external server 300 together with the identifier(S175). The controller 180 then outputs an announcement indicating thatthe object information reception is completed on the touchscreen 400(S176). The controller 180 also searches for a picture file having thesame identifier of the received identifier and then combines thereceived object information with the searched picture file (S177). Inthis instance, the object information can be stored together with thepicture file. Alternatively, the object information can be displayed onan image of the picture file when the picture file is played back.

In addition, one portion of an object information on one object can besearched from the object information database of the memory 160 and theother portion of the object information can be searched from the objectinformation database of the external server via the wirelesscommunication unit 110.

Also, one portion information (e.g., ‘basic information’) stored in theobject information database of the memory 160 can include non-variableinformation (e.g., a building location, etc.) on the object and/orsmall-size information (e.g., a building name, etc.) on the object. Theother portion information (e.g., ‘detail information’) stored in theobject information database of the external server can include variableinformation (e.g., a list of occupants in a building, etc.) on theobject and/or large-size information (e.g., multimedia information on abuilding, etc.) on the object.

In addition, the displayed object information includes textualinformation that the user can easily read to determine what places,buildings, etc. are located within the preview image.

Accordingly, the present invention provides several advantages. First,according to at least one embodiment of the present invention,information for helping the user such as a place or position informationwithin a preview image displayed for image photographing can be providedto a terminal user. Second, the user can easily determine names ofplaces or buildings within a photographed picture.

In addition, the above-described methods can be implemented in a programrecorded medium as computer-readable codes. The computer-readable mediainclude all kinds of recording devices in which data readable by acomputer system are stored. The computer-readable media include ROM,RAM, CD-ROM, magnetic tapes, floppy discs, optical data storage devices,and the like for example and also include Internet transmissions. Inaddition, the computer can include the controller 180 of the terminal.

The present invention encompasses various modifications to each of theexamples and embodiments discussed herein. According to the invention,one or more features described above in one embodiment or example can beequally applied to another embodiment or example described above. Thefeatures of one or more embodiments or examples described above can becombined into each of the embodiments or examples described above. Anyfull or partial combination of one or more embodiment or examples of theinvention is also part of the invention.

As the present invention may be embodied in several forms withoutdeparting from the spirit or essential characteristics thereof, itshould also be understood that the above-described embodiments are notlimited by any of the details of the foregoing description, unlessotherwise specified, but rather should be construed broadly within itsspirit and scope as defined in the appended claims, and therefore allchanges and modifications that fall within the metes and bounds of theclaims, or equivalence of such metes and bounds are therefore intendedto be embraced by the appended claims.

1. A mobile terminal comprising: a user input unit configured to receiveuser-inputs; a wireless communication unit configured to wirelesslycommunicate with at least one other terminal; at least one cameraconfigured to capture images; a touchscreen configured to display acamera preview image captured by the camera; a position-locationprocessor configured to obtain information on a current position of themobile terminal; and a controller configured to search for textualobject information corresponding to an object within the camera previewimage based on the current position of the mobile terminal, to controlthe camera to photograph the camera preview image and to store thephotographed camera preview image as a picture file, to output queryinformation to query whether the searched textual object information isto be stored together with the picture file, and to store the picturefile with or without the searched textual object information based on ananswer to the output query information.
 2. The mobile terminal of claim1, wherein the controller is further configured to store informationindicating the current position of the mobile terminal together with thepicture file.
 3. The mobile terminal of claim 1, wherein if the answerto the output query information indicates the picture file is to bestored together with the textual object information, the controller isfurther configured to output synthesized information querying whether ornot the textual object information is to be synthesized with the picturefile.
 4. The mobile terminal of claim 3, wherein if an answer to theoutput synthesized information indicates the textual object informationis to be synthesized with the picture file, the controller is furtherconfigured to perform a synthesizing process such that the textualobject information is synthesized together with the picture file, and tostore the picture file including the synthesized textual objectinformation as a single file.
 5. The mobile terminal of claim 3, whereinif an answer to the output synthesized information indicates the textualobject information is not to be synthesized with the picture file, thecontroller is further configured to store the textual object informationand the picture file as separate files, and to store linking informationlinking the picture file and the textual object information.
 6. Themobile terminal of claim 5, wherein if the stored picture file isselected to be displayed, the control unit is further configured todisplay the picture file together with the textual object information byusing the linking information.
 7. The mobile terminal of claim 1,further comprising: a memory configured to store an object informationdatabase including at least textual object information for objectswithin a predetermined vicinity of the current location of the mobileterminal, wherein the control unit is further configured to search forand obtain the textual object information corresponding to the objectwithin the camera preview image from the object information databasestored in the memory.
 8. The mobile terminal of claim 7, wherein thecontroller is further configured to populate the object informationdatabase by downloading, via the wireless communication unit, said atleast textual object information for objects within the predeterminedvicinity of the current location of the mobile terminal from an externalserver.
 9. The mobile terminal of claim 7, wherein the controller isfurther configured to obtain a first portion of the textual objectinformation for the object within the camera preview image from theobject information database and to download a second portion of the textobject information from an external server.
 10. The mobile terminal ofclaim 9, wherein the first portion of the textual object informationincludes non-variable information regarding the object, and the secondportion of the textual object information includes variable informationregarding the object.
 11. The mobile terminal of claim 1, wherein thecontroller is further configured to assign a first identifier to thephotographed camera preview image indicating a photographing time thephotographed camera preview image was captured.
 12. The mobile terminalof claim 11, wherein the controller is further configured to transmitthe assigned first identifier and a position and direction of the mobileterminal when the camera preview image was captured to an externalserver and to receive a second identifier and textual object informationcorresponding to the second identifier from the external server.
 13. Themobile terminal of claim 12, wherein the controller is furtherconfigured to match the second identifier with the first identifierassigned to the photographed preview image and to display the receivedtextual object information from the server with the picture file. 14.The mobile terminal of claim 1, wherein the position-location module isfurther configured to obtain a direction of the mobile terminal, and thecontroller is further configured to search for the textual objectinformation based on the direction and current location of the mobileterminal.
 15. A method of controlling a mobile terminal, the methodcomprising: allowing, via a wireless communication unit, wirelesslycommunication with at least one other terminal; capturing, via a camera,a camera preview image; displaying, on a touchscreen, the camera previewimage; obtaining, via a position-location processor, information on acurrent position of the mobile terminal; searching, via a controller,for textual object information corresponding to an object within thecamera preview image based on the current position of the mobileterminal; photographing, via the controller, the camera preview image;storing, via the controller, the photographed camera preview image as apicture file; outputting, via the controller, query information to querywhether the searched textual object information is to be stored togetherwith the picture file; and storing, via the controller, the picture filewith or without the searched textual object information based on ananswer to the output query information.
 16. The method of claim 15,wherein the controller is further configured to store informationindicating the current position of the mobile terminal together with thepicture file.
 17. The method of claim 15, wherein if the answer to theoutput query information indicates the picture file is to be storedtogether with the textual object information, the method furthercomprises outputting synthesized information querying whether or not thetextual object information is to be synthesized with the picture file,wherein if an answer to the output synthesized information indicates thetextual object information is to be synthesized with the picture file,the method further comprises performing a synthesizing process such thatthe textual object information is synthesized together with the picturefile, and to store the picture file including the synthesized textualobject information as a single file, and wherein if an answer to theoutput synthesized information indicates the textual object informationis not to be synthesized with the picture file, the method furthercomprises storing the textual object information and the picture file asseparate files, and storing linking information linking the picture fileand the textual object information.
 18. The method of claim 15, furthercomprising: storing, in a memory, an object information databaseincluding at least textual object information for objects within apredetermined vicinity of the current location of the mobile terminal;and searching for and obtaining the textual object informationcorresponding to the object within the camera preview image from theobject information database stored in the memory.
 19. The method ofclaim 18, further comprising: populating the object information databaseby downloading, via the wireless communication unit, said at leasttextual object information for objects within the predetermined vicinityof the current location of the mobile terminal from an external server.20. The mobile terminal of claim 18, further comprising: obtaining afirst portion of the textual object information for the object withinthe camera preview image from the object information database; anddownloading a second portion of the text object information from anexternal server, wherein the first portion of the textual objectinformation includes non-variable information regarding the object, andthe second portion of the textual object information includes variableinformation regarding the object.
 21. The method of claim 15, furthercomprising: assigning a first identifier to the photographed camerapreview image indicating a photographing time the photographed camerapreview image was captured; transmitting the assigned first identifierand a position and direction of the mobile terminal when the camerapreview image was captured to an external server; receiving a secondidentifier and textual object information corresponding to the secondidentifier from the external server; and matching the second identifierwith the first identifier assigned to the photographed preview image andto display the received textual object information from the server withthe picture file.